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PROPOSAL FOR PILOT RESEARCH 
COMMAND AND CONTROL - MEASURES OF EFFECTIVENESS 


Purpose: 








This metrics pilot project 15 designed to commence the Department’s investment in a new era of evidence- 
based training at LAPD. The Command and Control course was selected as the pilot project in order to 
determine the efficacy of the training since its inception in August of 2018. Ideally the outcome of this 
project will show that officers who completed the Command and Control course demonstrate an increased 
knowledge and application of the course material in on-the-job application scenarios. An assessment form 
was created that utilizes the PATROL Acronym to focus on three areas: De-escalation, Command and 
Control, and Procedural Justice. 


Methodology (Phase I): 


1. 24 officers (6 from each Bureau) will be randomly selected from the Command and Control 
course that took place in March 2019. 
2. For each officer, assessors will review three interactions with a suspect via BWV, 6 months prior 
to training being received. The three interactions include: 
A. A5150 H&S call 
B. A 211 PC in progress call 
C. A245 PC with a weapon call 
3. Assessors will then review the same three types of interactions with a suspect via BWV, that 


occurred 1 month after training was received. 
4. Assessors will then review the same three types of interactions with a suspect via BWV, that 


occurred 6 months after training was received. 

5. Assessors will use the newly developed form to rate each interaction for each officer. There will 
be a total of 9 assessments for each officer. 

6. Quantitative comparisons will be made between the pre-& post-assessments to assess for 
differences and determine the efficacy of the course in on the job application scenarios. 





24 randomly selected Suspect interaction A Suspect interaction A Suspect interaction A 
participants from Suspect interaction B Suspect interaction B Suspect interaction B 


Command & Control Suspect interaction C Suspect interaction C Suspect interaction C 
course March 2019 


Identified logistics to execute pilot project: 


1. Designated employees at the appropriate rank to ensure adequate and accurate scoring. 

2. This project will include the review of approximately 216 hours of BWV. 

3. Designated employees will need access to high speed internet as well as have access to 
Evidence.com to review and assess up to 216 hours of footage. 

4. Collaboration, support and oversight from Academic Partners for statistical assistance and 
oversight. 
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Is training achieving desired results? 


What is our return on investment? 


We must be able to measure and quantify training 
effectiveness. 


Through data analytics, participant surveys, 
partnerships, and academic research, PTE will 
demonstrate efficacy — or necessary corrective action. 


More than mere efficacy, we are building 
sustainable training solutions for the next generation 
of law enforcement leaders. 





Executive Summary 


In the current environment that is challenged by COVID and financial restraint, measuring 
the effectiveness of training is important for shaping future training efforts. We require 
more than promises of Quality Through Continuous Improvement and employee 
development. Our stakeholders must be supplied with compelling and data-driven 
evidence that training achieves successin field interactions and contributes outcomes that 


enhance community trust. 


Training will be examined Maximize the 
through the lens of Results, transfer of learning 
Behavior, Learning, and and behavioral 


Reaction. outcomes. 








Enhanced effectiveness of 
training, and optimized 
return on investment. 


We will demonstrate the 
value of training to the 
community. 
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Challenge 


Objectively measuring often subjective results 
under disparate conditions. 


oolutic мий its 
Using diverse data sets, surveys, 
outside research of varied training 
programs will generate desired 
outcomes. 





Using a unique data analysis dashboard populated with diverse metrics focused on results, learning, behavior, 
and reaction PTE will demonstrate a clear report on the efficacy or our programs. 





Whole-of-D ent Approach 


Engagement across Department entities will be vital to obtaining and accurate picture of effectiveness. 
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Task Academic 


| Research &POST 
Assignment Compliance Unit 


Stakeholders 


Tech LAPD 365, 
Required Surveys 


Additional 
Measures 





Results 








LAPD 365 is scheduled for soft Academic research is currently Review of proven methodology 
launch in 2021. Data will be underway from members of the from other agencies and 
gathered trom the Academy, FTO PAG (UCLA California Policy Lab, professions on evidence-based 
Program, and PSL. Pepperdine, CSUN and ОСТ). training and metrics 


This is a 2-year project. 


Behavior 


Facilitating the acquisition of knowledge that achieve success, 
contribute to positive outcomes in the field, and enhance public trust 
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Obtain accounts to Conduct needs Develop a test Analyze survey 
manage and distribute assessment for model based on results and monitor 
Surveys additional software 1 course that and evaluate data 
includes tracking collection. 
RMS, Recap, 





Sick time, and 
Retention 


Learning 


Multi-Faceted Assessment 


Research Stakeholders 
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Training Trainers Distance Learning 
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Carolyn Coles-Taylor at UCI will conduct а (se the Professional Advisory Committee 
2-year research project that follows thé — t5 conduct a literature review of academic 





recruit through the FTO Program. PTE has research. First reviews will include: 
reviewed the project, and will coordinate | 1) Efficacy of Scenario-Based Training; 8 
with Academic partners. 2) Proven Methods for Online Learning. 








Currently working with partners at 
Pepperdine, CSUN, George 
Washington University, USC, and the 
Museum of Tolerance to develop пем 
areas of interest for further research . 
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Professional Advisory Committee Sub- 
Group on Evidence-Based Policing is 
currently assisting the Director on 
identifying recommendations for measures 
of training efficacy. 
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PTE and PAC members are working to 
coordinate а webinar for instructor All instructor training is consistent with 
development in 2021, and preparing to evidence-based policing research. 
host instructors оп enhancing adult — 
learning, facilitation and critical-thinking. 
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PTE is reviewing and examining 
Instructor Evaluation Measures 
for Implementation in 2021. 
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Learning: Application Based 
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коо d 9361 UUU Mom Basis 2 Education delivery will be done оп an App. 
three distance learning programs, awaiting Program areas are: Racial Profiling and 
City Council to approve the distribution of Implicit Bias, De-escalation and Use of 


funds Force, and Organizational Wellness 
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STUDENT REVIEW SURVEY POST-COURSE SURVEY 


Conducted upon Course Completion Delivered at 6 months following the course 





Reaction 





INSTRUCTOR FEEDBACK EVALUATION 
Develop mechanisms for instructors Consistent re-evaluation of 
City-wide to provide feedback on training, programs, delivery 
course effectiveness mechanisms, and current trends 


or critical topics 










Ongoing feedback 











Risks to your plan and also plans 
to mitigate those risks 





High level timeline То implement 
the plan 


A communications priority plan. 


Distribution of results 





Implementation Timeline 


Phase I: Determine specifics 





SHORT TERM Ө 


RMS, Recap, Retention, Surveys, etc 


Populate, Monitor, Track 
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Phase 111: Analyze Data 





LONG TERM О 


Engage Stakeholders including ВОРС and ІС, Evaluate Courses 


N 





О 2022 





Phase IV: Publish Findings 





Strategic goals achieved, analyze, revisit 
Q0 d 








Build Connections: 


o Partners and 
Stakeholders 
o Chain of Command 





оо O о © 


17 


Communication Plan 





Engage and Influence: 


Instructors 

Training Coordinators 
Students 
Contributors 
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Programs 

Trends 

Update 

Field Test o Data being analyzed 


o IG, ВОРС 
o Outside Agencies, POST 


Methodology: 


Performance examination 6 months 
(~ prior to Command and Control 


Performance examination during the first 
month following the training. 





Purpose: This metrics pilot project is designed to commence a new aa с. | 

ега in evidence-based training at LAPD. The Command and Control Ael ee ena шо 
course was selected to determine the efficacy of the training since Command and vontro 

its inception in August of 2018. An already existing assessment 

form was improved upon for this pilot project as the rating tool. 


Hypothesis: Officers who complete the Command and Control 
course demonstrate the efficacy of the course in оп the job 
application scenarios. 


Pilot 
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Logistics: 


9 Incidents X 24 Officers = 216 Incidents 
* Clear any concerns with ERG and need to 
ensure anonymity for research purposes 


Ensure access to High Speed Internet to 
access and review body video 











Comprehensive metrics devised through diverse data sources and 
stakeholders is essential to improve training delivery and planning 
for future effectiveness іп achieving the desired outcomes апа 
community trust. 
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